Problem Note 61705: When you load data to SAS® LASR™ Analytic Server from Hadoop Hive, column values are set to zero
If you use SAS® LASR™ Analytic Server with SAS® Embedded Process to load data from Hadoop Hive, column values are set to zero. This issue occurs when the Hive table contains a DECIMAL column or FLOAT column.
Click the Full Code tab in this SAS Note to see an example of code that causes incorrect results to be reported in the SAS output window.
Click the Hot Fix tab in this note to access the hot fix for this issue.
Operating System and Release Information
SAS System | Base SAS | Microsoft® Windows® for x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8 Enterprise 32-bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8 Enterprise x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8 Pro 32-bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8 Pro x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8.1 Enterprise 32-bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8.1 Enterprise x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8.1 Pro 32-bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 8.1 Pro x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows 10 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2008 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2008 R2 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2008 for x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2012 Datacenter | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2012 R2 Datacenter | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2012 R2 Std | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Microsoft Windows Server 2012 Std | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Enterprise 32 bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Enterprise x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Home Premium 32 bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Home Premium x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Professional 32 bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Professional x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Ultimate 32 bit | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Windows 7 Ultimate x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
Linux for x64 | 9.4_M4 | 9.4_M5 | 9.4 TS1M4 | 9.4 TS1M5 |
*
For software releases that are not yet generally available, the Fixed
Release is the software release in which the problem is planned to be
fixed.
Code similar to the following causes this issue to occur. In the code below, your environment settings would be different.
libname hps hadoop DBCREATE_TABLE_OPTS="STORED AS ORC"
port=10000 server="myhive.sas.com"
SUBPROTOCOL=HIVE2 DBMAX_TEXT=32000 SCHEMA=default PROPERTIES="hive.fetch.task.conversion=more;hive.fetch.task.conversion.threshold=-1";
proc datasets lib=hps nodetails nolist nowarn;
delete HIVE_DECIMAL;
quit;
/* Create Hive table */
proc sql noprint;
connect to HADOOP as hivesrc (SUBPROTOCOL=HIVE2 SERVER="myhive.sas.com" DBMAX_TEXT=32000 SCHEMA=default PROPERTIES="hive.fetch.task.conversion=more;hive.fetch.task.conversion.threshold=-1");
execute (create table default.HIVE_DECIMAL (A varchar(10), B DECIMAL(2,0)) stored as orc) by hivesrc;
execute (insert into default.HIVE_DECIMAL values("val1", 31)) by hivesrc;
execute (insert into default.HIVE_DECIMAL values("val1", 42)) by hivesrc;
disconnect from hivesrc;
quit;
proc print data=hps.HIVE_DECIMAL;
Title 'Hivetable';
run;
proc lasr add
data=hps.HIVE_DECIMAL
signer="http://myhive.sas.com:7980/SASLASRAuthorization"
port=10011;
performance host="myhive.sas.com";
run;
libname LASRLIB meta library="Visual Analytics LASR" metaout=data;
proc print data=LASRLIB.HIVE_DECIMAL;
Title 'LASRTable';
run;
Type: | Problem Note |
Priority: | high |
Date Modified: | 2018-01-15 09:45:17 |
Date Created: | 2018-01-14 12:41:26 |